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}_( ' For a stochastic factor model we maximize the long-term growth 

, Cy ^ rate of robust expected power utility with parameter A £ (0, 1). Us- 

ing duality methods the problem is reformulated as an infinite time 
horizon, risk-sensitive control problem. Our results characterize the 
>0 , optimal growth rate, an optimal long-term trading strategy and an 

asymptotic worst-case model in terms of an ergodic Bellman equa- 
tion. With these results we propose a duality approach to a "robust 
large deviations" criterion for optimal long-term investment. 



1. Introduction. One of the basic tasks in mathematical finance is to 
choose an "optimal" payoff among all available financial positions which 
are affordable given an initial capital endowment. In mathematical terms, 
a payoff at a terminal time corresponds to a real-valued random variable on 
some measurable space (O, J^) and an investor faces a set X of such financial 
^ ■ positions. Any formulation of optimality will involve the investor's individual 

preferences >- on X. The relation X yY means that the investor prefers the 
payoff X over Y. Under mild conditions such preferences admit a numerical 
representation U:X^M (see, e.g., [17]); that is, for X, y € X it holds that 

g' X^Y ^^ U{X)>U{Y). 

CN ' In this context. Savage [36] clarified the conditions which guarantee that 

a preference order admits the specific numerical representation 



(1) U{X) = Eq[u{X)]= j u{X{uj))Q{duj), XgX, 

in terms of an increasing continuous function u:]R— t-MUJ— oo} 

ability measure Q on {Vt^T). Here Q appears as a "subjective" probability 



C^ . in terms of an increasing continuous function u:]R— t-MUJ— oo} and a prob- 
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2 T. KNISPEL 

measure which is imphcit in the investor's preferences, and which may differ 
from a given "objective" probabihty measure. The function u in (1) wih be 
concave if the investor is assumed to be risk averse. In that case, u is caUed 
a utility function. 

The hterature on optimal investment decisions in a financial market usu- 
ally involves the maximization of a utility functional (1) with respect to 
a given measure Q. Typically, Q is assumed to model the evolution of fu- 
ture stock prices and is thus viewed as the "objective" measure. But the 
price dynamics are not really known accurately, and so the choice of the 
evaluation measure Q is itself subject to model uncertainty or model am- 
biguity, also called Knightian uncertainty in the economic literature. There 
is another reason to depart from the standard setting of expected utility 
as formulated in (1): some very plausible preferences such as the famous 
Ellsherg paradox are not consistent with (1) (see, e.g., [17], Example 2.75). 
In order to overcome this limitation, Gilboa and Schmeidler [19] proposed 
a more flexible set of axioms for preference orders which leads to a "robust" 
extension of (1): instead of a single measure Q the numerical representation 
of the preference order involves a whole class Q of probability measures and 
takes the form of a "coherent" robust utility functional 

(2) U{X)=miEQ[u{X)]. 

This representation suggests the following interpretation: the investor has 
in mind a collection of possible probability distributions of market events 
and takes a worst-case approach in evaluating the expected utility of a given 
payoff. In recent years, there is an increasing interest in the maximization of 
the robust expected utility (2) of wealth X^°'^ attainable at time T > by 
investing in a financial market using some self-financing trading strategies ^ 
and the initial capital xq 

(3) maximize inf Eq[u{X^^'^)\ among all self-financing strategies ^. 

For general semimartingale models, this optimization problem can be solved 
by a duality approach (sometimes also called martingale approach) (see, e.g., 
Quenez [35], Schied and Wu [39] or Follmer and Gundel [14]). Their results 
provide a robust extension of the seminal paper by Kramkov and Schacher- 
mayer [27] for the classical utility maximization problem in incomplete mar- 
kets. The main advantage of the duality approach lies in the fact that the 
primal saddle-point problem is reduced to a minimization problem on the 
dual side. In many cases, the dual problem is much simpler and can be tack- 
led with another optimization technique (dynamic programming, BSDE). 

For a finite maturity, however, the optimal investment strategies for (3) 
will typically be time dependent, and they are often difficult to compute. 
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Instead we propose an asymptotic approach: we consider a long-term invest- 
ment model with one riskless and one risky asset whose drift coefficients are 
affected by an external stochastic factor process of diffusion type. Our model 
takes into account ambiguity about the "true" drift terms of both the factor 
process and the risky asset. The class Q of possible prior models corresponds 
to affine perturbations of the drift terms in a given reference model and is 
parameterized by stochastic controls. In this paper we focus on power utility 
u{x) = jx with parameter A G (0,1), but other utility functions are also 
feasible (cf. Remark 2.1). In our model the robust expected power utility 
will grow exponentially as time Tfoo, and this suggests to 
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(4) maximize lim —In inf EnliXrJ 



xo,i\X-\ 



among all strategies ^. 



This asymptotic formulation has the advantage of allowing for stationary 
optimal policies and may thus be more tractable. On the other hand, the 
asymptotic ansatz provides useful insight for portfolio management with 
long but finite time horizon. 

For the nonrobust case Q = {Q}, problem (4) is closely related to the 
maximization of the portfolio's risk-sensitized expected growth rate, 



(5) Aq{0,O---- 



■ lim 

Ttoo 



er 



■InE, 



Q 



exp 



■InX 



^o,S, 



e^o. 



In order to explain the nature of this criterion, let us consider the entropic 
monetary utility functional U0{X) := — ^ ln£^Q[exp(— 2^)], where is a pos- 
itive constant. The functional Uq is also well defined for < 0, and it can be 
extended to ^ = via Uo{X) := luiig^Qly(e{X) = Eq[X]. A Taylor expansion 
around 6 = (cf., e.g., [41], page 5) yields 



(6) 



UeiX) = EQ[X] + -VarQ[X] + 0(02) 



Thus 6 can be interpreted as a "risk sensitivity" parameter that weights the 
impact of variance. In particular, the Taylor expansion (6) suggests that 
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Ttoo 



^Q{e,0 = lim -EgilnX^'^''^] + - lim - VarQ[lnX^°'^] 



^ft^T 



a:o,Cl 
T 



The first term at the right-hand side is the portfolio's risk-neutral expected 
growth rate. The second term provides a risk adjustment specified by the 
portfolio's asymptotic variance and the risk sensitivity parameter 6, and 
so Aq{6,^) can indeed be seen as the risk-sensitized expected growth rate 
of wealth. On the other hand, the long-run growth rates of expected power 
utility u{x) = {0/2)x ''^ are, up to constants, of the form Aq{9,^), and the 
limit 0—7-0 corresponds to the growth rate of expected logarithmic util- 
ity. Such risk-sensitized portfolio optimization problems on an infinite time 
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horizon have received much attention (see, e.g., [3, 4, 9, 10, 28, 31, 33]). In 
those papers, the maximization of (5) among a class of trading strategies, 
viewed as dynamic controls, is reformulated as an infinite time horizon, risk- 
sensitive control problem of the kind studied in Fleming and McEneaney [8] . 
The rewritten problem leads to an auxiliary finite horizon "exponential of 
integral criterion." This is a standard problem in stochastic control theory, 
and its value function can be described by an appropriate Hamilton-Jacobi- 
Bellman (HJB) equation. As time tends to infinity, a heuristic separation 
of time and space variables in the HJB equation yields an ergodic Bellman 
equation. The optimal growth rate and an optimal trading strategy are char- 
acterized by a specific solution of this ergodic Bellman equation. 

In contrast to (5), our robust problem (4) involves also the minimization 
among the class Q, and this would lead to a stochastic differential game 
on an infinite time horizon. Our main purpose, however, is to develop an 
alternative approach: the main idea consists of combining the duality ap- 
proach in [39] with methods from risk-sensitive control. Our main results 
characterize the optimal growth rate 

A(A) :=supISI ;^ln inf Eq[(X^"'^)^], 

an optimal long-term investment strategy and an asymptotic worst-case 
model Q* G Q for robust expected power utility in terms of an appropri- 
ate ergodic Bellman equation. 

Such asymptotic results on robust utility maximization are not only of 
intrinsic interest but also relevant in connection to "robust large deviations" 
criteria to optimal long term investment. Suppose that the investor takes 
into account a class Q of prior models and wants to maximize the worst- 
case probability that the portfolio's growth rate L^'^ := y lnX^°''' exceeds 
some threshold cG M. In the spirit of large deviations theory (see, e.g., [6]) 
the asymptotic problem then consists of 

(7) maximizing lim —In inf Q[L^'^ > c] among all ^. 

The solution can be derived by a duality approach similar to the Gartner- 
Ellis theorem, but here the dual problem involves the optimal growth ra- 
tes A(A), A € (0, 1), of robust expected power utility. 

The paper is organized as follows: the setup is introduced in Section 2. 
Section 3 contains a heuristic derivation of our main results that are verified 
in Section 4. In Section 5 we discuss the existence of a solution to our ergodic 
Bellman equation. Explicit case studies are given in Section 6. In Section 7 
we describe the duality approach to the robust outperformance criterion (7). 
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2. The model and problem formulation. Let {Q,,T,{Tt)t>0:Qo) be the 
canonical path space of a two-dimensional Wiener process W = {Wf,W^)t>o- 
We shall consider a long-term horizon investment model with one locally 
riskless asset S^ and one risky asset S^. The performance of the market 
is determined by an external "economic factor" Y, driven by the Wiener 
process W. The spectrum of possible factors includes dividend yields, short- 
term interest rates, price-earning ratios, yields on various bonds, the rate of 

inflation, etc Both the price processes S^, S^ and the factor process Y 

will be subject to model ambiguity. This will be described by a class Q 
of probabilistic models, viewed as perturbations of the following reference 
model Qq. Under Qq the dynamics of the locally riskless asset is given by 

dS? = Sfr{Yt)dt, 5° = !, 

and the price process of the risky asset is governed by the SDE 

(8) dSl = Sj {m{Yt) dt + a dW^). 
Thus the market price of risk is defined by 

(9) e{y) := IlM^lM. 

a 

The factor process evolves according to 

(10) dYt = g(Yt) dt + pdWt = g(Yt) dt + pi dW^^ + p2 dWl 

We suppose that the economic factor can be observed but cannot be traded 
directly. Therefore the market model is typically incomplete. This class of 
market models is widely used in mathematical finance and economics (see, 
e.g., [5, 7, 18] and the references therein). Typically the difl'usion Y is also as- 
sumed to be mean reverting and ergodic with some invariant distribution /i. 
A special example is the Ornstein-Uhlenbeck (OU) process with dynamics 

(11) dYt = m{v-yt)dt + adW}, r/o>0,c7/0, 

2 

and invariant distribution /x = N(y, ^). 

We shall use the following general assumptions on the coefficients of the 
diffusions, summarized as 

Assumption 2.1. The functions g, m admit derivatives gy,my £ C^(M), 
and r belongs to C^{M.), where C^(M) denotes the class of all bounded 
functions with bounded derivatives up to order k. Moreover, we assume 
that a and ||p|| are positive and that the short-rate function r is bounded 
below by some constant oi > 0. 

Here we use || • || to indicate the Euclidian norm in M^, and in the se- 
quel (•,•) will denote the corresponding inner product. In particular, our 
assumptions ensure that the functions g and 9 satisfy the linear growth 
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conditions 

\giy)\ < a2{l + \y\) and \0{y)\<a3\y\+a4 for a2,a3,04 > 0. 

Note also that Assumption 2.1 is consistent with hnear drift functions g 
and m. In this paper, such a choice of the reference model will be particularly 
useful to obtain explicit solutions (cf. Section 6). 

In reality, however, the "true" price dynamics are not really known ex- 
actly. Here we focus on model uncertainty with respect to the drift terms 
appearing in (8) and (10). More precisely, we consider the parameterized 
class of possible probabilistic models 

Q-={Q''\v = ivt)t>o&C} 

on (J7, J^), where C denotes the set of all progressively measurable processes 
V = {'nt)t>o such that r]t = {rjt^ , r]P , ^t^ , rjt'^) belongs dt (8) Qo-a.e. to some 
fixed compact and convex set F C M^ which contains the origin. For r] £ C 
and any fixed horizon T, the restriction of Q^ to the a-field J-'t is given by 
the Radon-Nikodym density, 



(^2) D"^ — ^^ 



:=£( [ vl'Yt + rjfdWt 



with respect to the reference measure Qq. Here £{■) denotes the Ito exponen- 
tial. To see that DJj-, is indeed the density of a probability measure on (Q, J^t), 
we can argue as follows: by Assumption 2.1 the diffusion process Y satisfies 
the regularity conditions required in Lemma A.l, and so there exists some 
6 > such that supo<j<7--B(3o[exp((51^^)] < oo. The compactness of F thus 
ensures that 

(13) sup EQ^[exp{e\\ril-Yt + riff )]<oo 

0<t<T 

as soon as e > is chosen sufficiently small. According to [29] , Example 3, 
Section 6.2, this yields Eq^[Dj,] = 1 as desired. 

In view of (12) we have Qo = Q^ £ Q, and it follows as in [23], Lemma 3.1, 
that Q is a convex set of locally equivalent measures on (0,, T). By Girsanov's 
theorem, 

Wl^ := (wl - ^ vl'Ys + ilf ds, Wi - ^ ril^Ys + vf ds^ t> 0, 

is a two-dimensional Wiener process under the measure Q^, and the dynam- 
ics of S"^, Y under Q^ take the form 

(14a) dYt = [giYt) + (p, vJ'Yt + if)] dt + pdW:>, 

(14b) dS^ = SJ{[m{Yt) + aivl'Yt + r?f )] dt + adWl''^). 
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Roughly speaking each element of Q corresponds to an affine perturbation 
of the drifts in our reference model Qq. In particular, our "robust" market 
model includes the following special cases (see Section 6): 

Example 2.1 (Black-Scholes model with uncertain drift). 

r{y)=r, m{y)=m, T = {(0,0)} x [a,6] x {0}. 

Example 2.2 (Geometric OU model with uncertain mean reversion). 
The factor process Y is an OU process under Qq with rate of mean reversion 
r/o > 0, mean reversion level y = and volatility o" > [cf. (11)]. We also 
assume S^ = exp(rt), r > and Sj := exp(l^ + at), a G M. By Ito's formula 
this corresponds to 

9{y) = -my, Pi=cr, P2=0, m{y) = -r]oy + ^a"^ + a. 

Moreover, we take the set T := [^, 22^] x {(0,0,0)} for < a < 6 < oo. 
For any Q^ G Q the process Y thus follows under Q^ G Q OU-type dynamics 
with mean reversion process r/o — crrj^^, taking values in [a,b]. 

Let us now formulate our main problem. We consider an investor with 
initial capital xq > who aims at optimizing his portfolio in the long run. 
A trading strategy will be a predictable stochastic process (, = {$.^,£,^) whose 
components ^^ and ^^ describe the successive amounts invested into the 
bond and into the risky asset. The value of such a portfolio at time t is 
given by X^ = ^tS^ + S,tS}. We also assume that ^^ is 5^-integrable. Such 
a trading strategy S, is said to be self-financing for the given initial capital xq 
if its wealth process X^ = {X^)t>o takes the form 



(15) X^ = xo+ [ CdS^^+ I ildSl 

Jo Jo 



Here the (stochastic) integrals can be interpreted as cumulative gains or 
losses, that is, any change in the portfolio value equals the profit or loss 
due to changes in the asset prices. For notational convenience we omit the 
explicit dependence of X^ on the initial capital xq, since it will be irrelevant 
for our purpose of long-term investment. 

Definition 2.1. A self-financing trading strategy ^ is called T -admissi- 
ble if X^ > for all t G [0,7"]. A strategy ^ will be called admissible if it is 
T- admissible for any time horizon T > 0. We denote by At the class of all 
T-admissible strategies and by A the class of all admissible strategies. 

Clearly, a self-financing trading strategy ^ can also be described by the 
fractions 

tlcl 
VTt := — ^, t>0. 



Xt 



« 
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of the current wealth which should be invested into the risky asset. Through- 
out this paper we identify a strategy S, with the fractions vr = (7ri)(>o. In 
terms of vr the wealth process defined in (15) takes the form 

Jo '->u Jo >->u 

that is, the investor's wealth X'^ evolves according to the SDE 

(16) * 

= X^{r{Yt) dt + ^t<ymYt) + li^Yt + iif) dt + dWl^"^]) 

with initial condition X^ = xq. 

In order to specify optimality, we assume that the investor's preferences 
in the face of model ambiguity are described by a power utility function 

u{x) = -rx with risk aversion parameter AG (0, 1), 

A 

and the set of prior probabilistic models Q (cf. page 2). For a finite matu- 
rity T, his robust portfolio selection problem then consists of 

(17) maximizing inf Eqv[u{X^)] among all tt & At- 

In a general semimartingale setting, this problem is well understood from 
a theoretical point of view, in particular due to the articles [14, 35, 39]. 
For robust market models of the diffusion type described above and for 
power utility, problem (17) has been discussed recently by Schied [38]. Ap- 
plying dynamic programming methods to the dual problem, he determines 
the maximal robust expected utility and a worst-case model in terms of 
a Hamilton- J acohi-Bellman equation. Here we do not limit the analysis to 
a fixed maturity. Instead the objective of our investor consists of maximizing 
the long-term growth of robust expected power utility. A priori estimates, 
as established in Lemma 3.1, suggest that the maximal values 

(18) U^{xq):= SUV Eq[u{X^)1 C/t (xq ):= sup inf SQ.[n(Xf)] 

for the classical utility maximization problem under Q and for its 
robust extension will grow exponentially as T \ oo. Thus it is natural to 
try to 

(19) maximize lim— In inf EQri[{X^) ] among all vr G ^. 
Our goal is to identify the optimal growth rate, 

(20) A(A) :=sup h^ iln inf i?Q.[(Xf)^], AG (0,1), 



ASYMPTOTICS OF ROBUST UTILITY MAXIMIZATION 9 

an optimal long term investment strategy vr* and an asymptotic worst-case 
model Q^ £ Q. Heuristically this means that, as Tfoo, 

(21) C/^(xo)«i4e^W^ 

(22) ^mf^EQn[u{Xf)] 

(23) « U^"' (xo) = sup Eq,^ [n(Xf )] 

(24) ^EQ^^uiXf)]. 

Here (22) corresponds to asymptotic optimality of the trading strategy vr*, 
(23) to the property of Q^ of being the asymptotic worst-case model, 
and (24) identifies vr* also as the asymptotically optimal strategy for the 
model Q^ . In particular, Q'^ and vr* can be viewed as a saddle point for 
the problem of asymptotic robust utility maximization with control param- 
eters r] &C and n £ A. Moreover, (22) suggests that an optimal strategy vr* 
of the asymptotic criterion (19) should provide a good approximation of an 
optimal investment process vr*' for the robust power utility maximization 
problem with a large but finite time horizon T. 

Remark 2.1. The asymptotic approach to robust utility maximization 
can be extended to the following cases (see [26], Chapter 4): 

• For power utility u{x) = jx^ with parameter A < the distance between 

Ut{xo) = ]- inf sup Eq,[{X^)^] 

and its upper bound will typically decrease exponentially as T f oo. This 
suggests that we should compute the optimal growth rate, 

A(A) := inf lim ;^ln sup EqvUX^)^]. 

• For logarithmic utility u{x) = ln(3;) the growth of robust expected utility 
will be linear. Thus we want to 

maximize lim — inf Eov\ln(XT)] among all tt £ A. 

3. Heuristic outline of the dynamic programming approach. We start 
with a heuristic derivation of our main results. They provide a characteriza- 
tion of the optimal growth rate A(A) , of an asymptotic worst-case model Q^ , 
and of an optimal long-term investment strategy vr* in terms of an ergodic 
Bellman equation (EBE). Our method combines the duality approach to 
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robust utility maximization with dynamic programming methods for a vary- 
ing time horizon. As a byproduct of the duahty approach, we also show 
that Ut{xq) grows exponentially at rate A(A) as Tfoo. A more direct, but 
not more tractable approach to the saddle-point problem (19) via stochastic 
differential games will be discussed in Remark 4.2. 

First, we set up the duality approach based on the results of Schied and 
Wu [39] for a utility function u on the positive halfline. This will allow us to 
transform the primal saddle-point problem (19) to a simpler minimization 
problem on the dual side. The dual value function at time T is defined by 

(25) VT{y):=x^i \ni EQ[v{yYT/SU, y > 0, 

where v{y) := sup2,>Q{ti(x) — xy}, y > 0, is the convex conjugate function 
of u. This definition also involves the class of supermartingales 

3;^ := {Y > 0|yo = 1 and Vvr G ^t : {YtX^ / S^^)t<T is a Q-supermartingale} 

as introduced by Kramkov and Schachermayer [27]. Note that y^^ contains 
the density processes (taken with respect to Q and the numeraire S^) of the 
class Vt of all equivalent local martingale measures on (i7, J"t). For power 
utility we have v{y) = — /3~^y^, /? := j^, and this yields the scaling property 
^(y) = y^^(l)- Due to [39], Theorem 2.2, the primal value function (18) 
can then be obtained as 

(26) Ut{xo) = mf{VT{y) + xoy} = \x^{-PVt{1))^-\ 



[39], Theorem 2.5, also that 

(27) Vt(1) = inf inf Er 



j/>o A 



Since power utility has asymptotic elasticity lim.,j.foo ^^( V < 1, it follows from 



dP 
dQ 



/5° 



We now parameterize the sets y!^ and Vt- Since Zt := dP/dQo\Tt, t <T, is 
a positive Qo-™artingale for any P G Vt, the martingale representation the- 
orem yields the existence of an M'^-valued progressively measurable process 
0= ((/)^,(/)^) with /q ||(/!)spds < 00 Qo-a.s. such that Zt = £{jQ(l)sdWs)t- By 
Girsanov's theorem, the discounted wealth process X'^ / S^ is a local martin- 
gale under P if and only if (j)]. = —OiYg) ds ® Qo-a-e. Thus the Qo-density 
process of an martingale measure P G Vt necessarily takes the form 

(28) Zr :="?(- ^ (^{Ys) dWl -J^us dW^^ 

for some progressively measurable process u such that L v^ds < 00 Qq-&.s. 
Conversely, Z^ corresponds to the Qo-density of an equivalent local martin- 
gale measure on (0,,J^t) as soon as the martingale condition Eq^lZif] = 1 
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holds. This can be verified if, for instance, the process v is assumed to be 
bounded. Thus our market model admits a variety of equivalent local mar- 
tingale measures up to any finite horizon T; that is, the restriction of our 
model to a finite horizon is arbitrage- free but incomplete. 

More generally, we will denote by M the set of all progressively mea- 
surable processes v = (ft)t>o such that f^ uf dt < oo Qo-a.s. for all T > 0. 
Via (28) every i/ £ M gives rise to a positive Qo-supermartingale Z'^ . Us- 
ing Ito's formula one easily shows that {W^)"^ Z'^ X'" / S^ is a positive lo- 
cal martingale under Q"^ for any u £ M and vr G At, and hence a Q^- 
supermartingale. Thus 

In view of (25), (27) and (26) this inclusion and a change of measure yield 

(29) C/T(xo) = yXo^(inf inf^Q„[(Z^(50)-i)V(A-i)(i)^)i/(i-A)]y-'. 

In a second step, we derive an ergodic Bellman equation by applying dynamic 
programming methods to the dual minimization problem. Since Z^, Dj. 
and the bond price Sj, depend on the factor process Y, the expectation at 
the right-hand side of (29) is a function of the initial state Yq = y. For all 
processes r/ G C and z^ G 7W we can thus define 

(30) y (r?, ^, y,T):= Eq, [(^^(5° )"!) ^(^"1) (Z)^) V(i-A)] . 
Inserting the definitions of Z^, D^ and Sj^ we then obtain the decomposition 

(31) y(r?,z.,y,r) = i^Qjf^'Vo"^(^^''^*'^^)'^*]. 
Here the function / : T x M x M — ^ M+ is defined by 

Z(r?,^^,y):=^^^^[(e(y)+r?"y + ^2i)V(i^ + ryi2y + ^22)2] 
(32) 






and 



£r--=£[-^[[^m)+vl'yt+vfdw^+j'^\u,+4'Y,+^fdw^ 

To simplify the expression for V{r],v,y,T), we shall interpret the Ito expo- 
nential as the density of a probability measure W''^ on (0, J-t)- This requires 
Eqq [£q^'^] = 1 which is satisfied, for example, if /g u^ dt is bounded. For ar- 
bitrary z^ G A^ we may have Eq^ [^t^] < 1 , but here we argue heuristically. 
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and so we postpone this technical problem to the proof of Theorem 4.1. In 
terms of the measure R^''^ we can write 

(33) V{v,u, y, T) = Er,. [e^o '(''*'-^'^*) <''] . 

Moreover, Girsanov's theorem yields that the factor process {Yt)t<T evolves 
under RP''^ according to the SDE 

(34) dYt = h{7]uVt,Yt)dt + pdW'^'\ 

where W^'" is a Wiener process under R^'^ and where h is defined by 

h{r], v,y) := g{y) + r-pi(A0(y) + ri^^y + if^) 

(35) /-' 

Putting (29), (30) and (33) together, we get 

(36) C/T(xo) = i4t;(y,r)i"\ 

where 

v{y,T):= inf inf ^Rr,,.[ei'6^'(''*'^*'^*)'='*] 
ueMrieC 

denotes the value function of the finite horizon optimization problem on the 
dual side of (29). Such an "expected exponential of integral cost criterion" 
with a dynamics of the form (34) is standard in stochastic control theory 
(see, e.g., [11], Remark IV. 3. 3). As a result, v can be described as the solution 
to the Hamilton- J acohi- Bellman (HJB) equation, 

(37) vt = -\\pfvyy+ml\nl{l{r],v,-)v + h{r],v,-)vy], u(-,0) = l. 

The following lemma establishes a priori bounds for the exponential growth 
of robust expected power utility, and this justifies the scaling in (19). 

Lemma 3.1. Suppose in addition to Assumption 2.1 that one of the 
following conditions is satisfied: 

(1) The market price of risk function 6 in (9) is hounded. 

(2) There exist constants K,Mi,M2 > such that 



^^p,9{y)<-Ky + M,, ^^J^J^''"' ^ '^' 



-Ky + Ml < g{y) + -pi^(y) < -Ky + M2, 2- ryj\\pfal < K^ 



Then there are constants Ki , K2 > such that for any initial capital xq > 
(38) Ki < lim ;^ln[/r(xo) < li^ ;^lnC/T(xo) < K2. 
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Proof. If at any time the whole capital is put into the money market ac- 
count, then the investor's utility at time T is given by -^Xg exp(A/Q r{Yt) dt) 
which, by Assumption 2.1, is bounded from below by ^Xq exp(AaiT). This 
implies the lower bound 

0<Ki := Xai < lim —lnUT{xo)- 
rtoo T 

To obtain the upper bound, observe first that 

v{y,T) < ViO,0,y,T) < ii;«[e(V2)(A/(i-A)2)/o^e2(y.)<ii]e(A/(i-A))i|r-|UT^ 

where R := R^'^ is the probability measure defined by £rp' . In view of (36) 
we thus get the estimate 

m^lnUHxo) 
(39) 

<(l_A)Ih^ilnii;^ie(V2)(A/{i-A)2)/o"<?^(rOrfi] + A||r||oo. 

In particular, the upper bound in (38) holds with K2 := ^j^H^H^ + -^lklloo 
if the market price of risk function 6 is bounded. 

Case (2) requires more effort. By (39) it is sufficient to show that 



(40) lim- In ^/j 



1 A 



exp(7T7^^T2 /^ (^ (Xt)dt 



2(1-A)2 



T 



< 00. 



To this end, recall from (34) that the dynamics of Y under R are given by 



.0,0 .,, , / — N / N . A 



dYt = h{0,0,Yt)dt + pdW^''' with h{0,0,y) = g{y) + r^—^piOiy). 

Consider now the R-0\J processes dZu = [—KZu + Mi] dt + pdW^ ' , Zjq = y, 
i = l,2. Then a comparison argument for the solutions of SDEs ensures that 

(41) R[Zu <Yt< Z2t for aU t > 0] = 1. 

Take now e > satisfying 2 ^^_^.^ IIpIP(Q3 + e) < K"^- By Assumption 2.1 
there exist constants Ci, C2 depending on e such that 

0^{y) < {aM + a^f < Ul + 2/2 + Ci < {4 + e){y- M,/Kf + C1 + C2 

for any y G M. Together with (41) and Holder's inequality (applied in line 3) 
this leads to 

^^[e(i/2)(A/{i-A)2)/(fe2(yi)di] 

<Si?[e(^/2)(A/{l-A)2)(ai+£/2)/„^r,2di]g{l/2){A/(l-A)2)CiT 
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(42) 



i=l,2 
i=l,2 

Here we use the processes Zj, i = 1,2, defined by Zji := ||/3||~-'^(Zjt — Mi/K). 
Note that Zj is an OU process with rate of mean reversion K, equilib- 
rium level and volatility 1, since B := Jq{\\p\\)^^ p dW^ ' is a standard one- 
dimensional i?-Brownian motion, due to Levy's characterization. Applying 
Lemma 4.2 in [13] [here with A = 0, p= ti\yi ||jo|P(Q3 + e) and ^o = —K] 
for the asymptotics of the Laplace transform of the energy integral of a nor- 
malized OU process, we obtain 

lim-ln^p[e(^/(i-^)')ll''ll'("i+^)io'^''^*l 
TtooT ^ ^ 



K-xlK^-2j:^—^\\pnal + e) 



2l^ V (1-A)^ 

In view of (42) we have thus shown (40). This completes the proof. D 



Combining the discussion of (21) with (36), it is natural to expect that the 
optimal growth rate A(A) in (20) satisfies 

A(A) = h^ 1 In C/t(xo) = Ih^ ;^ ln(^(2/, Tf~^). 

Tfoo 1 Tfoo 1 

As in Fleming and McEneaney [8] we now use a formal separation of time 
and space variables and formulate the heuristic ansatz 

(43) (1 - A) ln^(y, T) = In Ut{x^) « A(A)T + ^{y). 

Here the function 99 : R — t- M incorporates the influence of the initial state 
Yq = y. Inserting this ansatz into the HJB equation (37), we obtain a steady- 
state dynamic programming equation for the pair (A(A),C/9) 

1 

II nil ^ in.,... -I- 

(44) 

-I- inf inf{(l - X)l{r],u,-) + ipyh{r],u,-)}. 



A(A) = ^||pf 



1 ,2 



ueRrjer 



An equation of this type is called an ergodic Bellman equation (EBE) (see, 
e.g., [1, 25, 30] and the references therein). For fixed rj £T the minimi- 
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zer v*{rj,y) among all ;/ G M can be computed explicitly as 

(45) i'*{r],y) = -r]^^y-r]^'^ - p2(py{y). 

Thus the EBE (44) can be rewritten in condensed form that involves only 
an infimum among the set T. Let us now assume that our EBE (44) admits 
a solution A(A) G M+, if G C^(M). In addition, assume that 'i]*{y) is a mini- 
mizer in (44), and let Q^ G Q be the probabilistic model corresponding to 
the feedback control tj^ = r]*{Yt). We are now going to give a heuristic argu- 
ment to identify a candidate for the optimal long-run investment process vr* . 
To this end, we suppose that the measure Q^ is a worst-case model in the 
asymptotic sense that 

(46) A{X) = mhnUT{xo) = mhn sup EQ.^iX^)^]. 

Later on we will show that this assumption is indeed justified. We are now 
going to introduce a change of measure which will allow us to interpret 
the finite time maximization problem at the right-hand side of (46) as an 
exponential of integral criterion. For this purpose, note that an optimal 
wealth process should stay positive, and this suggests that we should focus 
on those strategies tt G A, where the unique strong solution to (16) takes 
the form 

In this case the expectation at the right-hand side of (46) can be rewritten as 

Here we use the notation 

(47) T(7r, 7?, y) := \\{\ - l)a\^ + \a[e{y) + r,^^y + r?2i]vr + Ar(y), 
and K^'"^ denotes the probability measure on {Q^^Ft) defined by 



£[ I Xi^tadWh'^ 



to UVV j- 



By Girsanov's theorem, the dynamics of (l^)t<r under EJ^'^ are described by 

(49) dYt = h{^t:r]t,Yt)dt + pdW^''' 
in terms of the function h defined by 

(50) /i(7r, ??, y) := g{y) + (p, rj^'y + rf') + Xpia-n 

and the one-dimensional Wiener process W^'"^. We have thus shown that 
the finite horizon maximization problem appearing in the right-hand side 
of (46) can be viewed as a finite horizon control problem with value function 



v{y, T) := sup Eq,* [{X^f] = x^ sup E^..,^. [e/o ii-uv'{yt),yt) 

ttGA ttGA 



dt] 
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and with dynamics (49). In analogy to (37), we expect that v is the solution 
to the HJB equation 

(51) vt = -\\p\\'^Vyy + sup{l{TT,r]*,-)v + h{TT,r]*,-)vy}, v{-,0) = l. 

^ vreM 

Our ansatz (43) combined with (46) for the worst-case measure Q^ now 
suggests the heuristic separation of variables lnu(y,T) ~ A(A)T + ^p{y). In- 
serting this asymptotic identity into (51), we finally obtain an alternative 
version of the EBE, 

^" 'i2r,, , ,,2i 



(52) A(A) = -\W\^yy + ^;] + sup{/(7r,?7*, •) + c^y/i(7r,?f , •)}• 

Note that the role played by the controls r] and v in (44) is now taken over 
by the "trading strategies" vr. We expect that the maximizing function 

(53) vr*(y) = ^i(pi^,(y) + ^(y) + ^^^^\y)y + ^12,* (y)) 

in (52) provides an optimal feedback control tx\ = 7r*(lt), t >0, for the 
asymptotic maximization of power utility with respect to the specific mo- 
del Q^ and at the same time for the original robust problem (19). 

4. Verification theorems. In this section we verify our heuristic results. 
For this purpose, we first return to the heuristic change of measure in (33) 
which is crucial to translate the dual problem (29) into a standard "ex- 
ponential of integral criterion." Prom the technical point of view this re- 
quires the condition Eq^ [S^''^] = 1 that can be violated if the supermartin- 
gale Z'^ is not a true Qo-mcirtingale. This fact will create some technical 
difficulties. To overcome this obstacle, we shall employ a localization argu- 
ment. 

Lemma 4.1. Let rj £ C and v £ M be arbitrary controls, and suppose 
that (T„)„gN is a localizing sequence of stopping times for the local Qq- 
martingale Z^ . Then V{ri,i',y,T A Tn) /^ V{ri,i',y,T) as n f oo, and the 
integrands in (30) even converge in L}{Qq) ifV{ri,v,y,T) < oo. 

Proof. The proof is given in [38], Lemma 3.2. The main idea consists 
of applying the concept of extended martingale measures introduced in [14] . 
D 

In a second step we are going to show that the value A (A) given by 
a specific solution to the EBE (44) is actually the exponential growth rate 
of the maximal robust power utility Ut{xq). Por this purpose, we need 
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Assumption 4.1. Suppose that A(A) G M+, ip G C^(M) is a solution to 



~m = \\\pf 



1 2 



V'j/S/ + --X ^'Py 



1-A 

(54) 

+ mf mf {(1 - A)/(r?, v, •) + c/9y/i(r?, i/, •)}, 

which fulfills the following regularity conditions: 

(a) Either the first derivative ipy is bounded or ip is bounded below, and 
its derivative (py has at most linear growth, that is, 

IV'yCy)! < C\{V + \y\) for some constant C\ > 0. 

(b) There exist C2, C3 > such that yK,{ri, y) < — 6*2?/^ + C3, where 

<^h y) ■■= giy) + -. rPiiOiy) + r/"y + t?^^) 

(55) ' - ' 



1-A 



2 I 2 
P1 + P2 



Vy{y)- 



In full generality, we are unfortunately not able to clarify whether the 
EBE (54) has such a solution (A(A),(/9). In Section 5 we are going to state 
sufficient (but rather restrictive) conditions under which the existence of 
a solution to our EBE (54) is already known. Moreover, Section 6 contains 
two case studies with linear drift coefficients, where the solution can be de- 
rived even explicitly. But as illustrated in Section 6^2 in case of the geometric 
OU model, there may exist multiple such pairs (A(A),(/9), even beyond the 
fact that (/? is determined only except for an additive constant. However, the 
verification theorems will require a certain "uniform ergodicity condition" 
such as Assumption 4.1(b) for the diffusion y, and this condition selects the 
"good candidate" for the optimal growth rate A(A) (cf. Remark 6.2). 

Theorem 4.1. If Assumption 4-1 is satisfied, then we get the identity 

(56) A(A) = lim — ln( inf inf y(7?,z^,yo,T)^"^) foranyYo = yo. 

Moreover, the infinia at the right-hand side are attained for feedback controls 

(57) V*t-=V*iYt), v*:=v*{Yt), i > 0, 

defined in terms of a measurable T-valued function rf and the function 

y*[y) ■= u*{r]*{y),y) = -r]^'^'*{y)y - T]^^'*{y) - P2^y{y) 
such that the infima in (54) are attained. Thus, 

(58) A{X)=hm^ln{V{v\iy*,yo,Ty~^). 
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In particular, the duality relations for robust utility maximization yield that 

(59) A(A) = lim 1 In Ut{xo) = lim ^ In U^"* (xq) for any X^ = xq. 

Tfoo 1 Tfoo 1 

Remark 4.1. In view of (59), Q^' can be seen as the asymptotic worst- 
case measure for robust expected power utility with parameter A G (0, 1). On 
the other hand, the probability measure P^ on (fi, J^) with Radon-Nikodym 
density process {Zj^ )t>o is a martingale measure which is equivalent to Qq 
on each cr-algebra J-t, t > 0. In view of (58) and the duality relation (26) it 
can be interpreted as the asymptotic worst-case martingale measure. 

Proof of Theorem 4.1. (1) In order to show that the constant A(A) 
given by the specific solution (A(A),c/9) to the EBE (54) coincides with the 
exponential growth rate of the maximal robust power utility, we first prove 
that A(A) provides a lower bound for the growth rate. To this end, we use 
the duality relation 

C/t(xo) = ^4 inf inf F(r/,i/,y,r)i-^ 

[cf. (29)] with V introduced in (30), derive suitable lower bounds for any 
fixed horizon T and then pass to the hmit. 

Let rj £C, u ^ M be fixed controls, and let T be a given maturity. Then 
Tn '■= inf{t > 0| jltl > n or Jg z^f ds > n} A T, n G N, is a localizing sequence 
for the local Qo-™artingale {Z^)t<T- This will allow us to apply the change 
of measure (33) locally and to use the localization Lemma 4.1 for r^ t T. In 
analogy to (31) we obtain 

y (r?, zv, yo, r„,) = Eq, [^T^'f e/<^" l{vt,'^uYt)dt^ ^^^^ 

where I is the auxiliary function defined in (32), and where 

To eliminate the Ito exponential Et^ i we pass to the new probability mea- 
sure Rn^ on {VI,Ft) with density process dRJl''^ /dQ(j\jr^ := £^^^^, t G [0,r]. 
It remains to justify this change of measure. For this purpose, note that 
the process 7/ G C takes its values in a compact subset F C M"* and that 
6*^(2/) < (as 1 2/1 + 04)^ < 2(o|y^ + a\), due to Assumption 2.1. Using the defi- 
nition of Tn we can verify the Novikov condition (see, e.g., [29], Theorem 6.1 
and the note after it). This allows us to write 

(60) y (r?, I/, yo, r„) = E^. [e/<> " '(^^''^*'^*) % n G N. 
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By Girsanov's theorem, the dynamics of Y fohow under Rn'^ the SDE 

(61) dYt = h{r]t,iyt,Yt)dt + pdW;'''' on {t < t„} 

for the drift function h given by (35) and for a two-dimensional iJ^'^^-Wiener 
process W^'^ . Note that (60) can be viewed as a cost functional of an "ex- 
pected exponential of integral criterion" with dynamics (61) (cf. page 12). 
Let us next introduce the auxiliary function 7 > by 

livi i": y) ■= (1 - ^)K^> ^^ y) + 'Py{y)Hv, ^, y) 

(62) 

- mf {(1 - \)l{ri, u, y) + (py{y)h{r], u, y)}. 



Inserting the minimizer v*{r],y) introduced in (45), we then see that 7 takes 
the condensed form 



(63) 



7(r?, u, y) = -{v - u* (77, y)f. 



21- A 

Later on this representation of 7 will be crucial to eliminate the control u 
in the dynamics of Y . In terms of 7 our EBE (54) yields the inequality 



A(A)<^||p|| 



Vyy + 



1 



1-A 



^l 



(64) 

+ (1 - A)/(?7, V, ■) + ipyh{r], u, •) - 7(r/, u, •). 

By Ito's formula applied to ip £ C^(M) and to the dynamics of Y in (61), 
this estimate translates on {u < r„} into 

ip{Yu) - ipiyo) 



(65) 



: r ^y{Yt)h{T^t,yt,Yt) + \\\pf^yy{Yt)dt+ [^ ^y (Yf) p dWj^ '" 

Jo ^ Jo 



> /"a(A) 

'0 



1 1 



21-A 



pr^t{Yt)-{l-\)l{r]t,ut,Yt) 



+ ^{Vt,i^t,Yt)dt+ r ^y{Yt)pdW;^'\ 
Jo 



Dividing through 1 — A, rearranging the terms and taking the exponential 
on both sides, we thus obtain from (60) that 

V{'n,iJ,yo,Tn) 



> EnV-' 



(66) 



g(l/(l-A))(A(A)r„+v(j/o)-/'(^r„)+/J""7('?t,^t,'n)rfi) 

V>yiYt) 



x£ 



-pdw;"^" 
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Here the last expectation is taken with respect to the probabihty mea- 
sure i^n*^ on {fljj^x) with density process 



dR^^ 



'11, V 



dR 



r),i/ 



£ 



Tt 



1-A 



dWY 



tATn 



Indeed, since ipy grows at most Hnearly according to Assumption 4.1(a), 
this change of measure can be justified again by Novikov's condition (cf., 
e.g., [29], Theorem 6.1 and the note after it). By Girsanov's theorem, the 
factor process Y evolves under Rn'^ according to 



dYt 



h{7]t,i't,Yt) + 



1-A 



Ipf^yiYt) 



dt + pdW' 



ri,i/ 



on {t<Tn}, 



where W^''^ denotes a two-dimensional Rn'^-Wiener process. But these dy- 
namics still depend on the irrepressible control v. To eliminate this depen- 
dence, we apply once more a Girsanov transformation. Consider the proba- 
bility measure Rn on {Q,,Tt) with density process 



dR?, 



dRY 



£ 



Tt 



A 

i"^' 



z.*(r/„n)-i.,)dM^?'^''^ 



tATjj 



Verifying once more Novikov's condition, we see that R!n is well defined, and 
so the inequality (66) translates into 



(67) 



y{^^V,yQ,Tn) 



^^i^ 



,(l/(l-A))(A(A)r„+¥.(3/o)-¥'(n„)+/o""7('?t,!^t,^t)rft) 



dRY 



dRl 



Tr, 



Moreover, Girsanov's theorem yields that the dynamics of Y under i?^ on 
{i ^ "^n} takes the form 



dYt 



hii]t,i^t, Yt) + Y-^WpfM^t) + Y-^P2i'y*ivt,Yt) - ut) 



dt + pdWP 



in terms of the two-dimensional i?n-Wiener process W^i. Recalling 
from (35) and (45) the definitions of the drift function h and of the minimi- 
zer i'*{t], y), a straightforward computation shows that this SDE is equivalent 
to 



(68) 



dYt = K{rjt,Yt)dt + pdWt'', 



where k denotes the auxiliary function introduced in Assumption 4.1(b). 

To eliminate the density dRY /dRnl^^^, we define p := —^ < and apply 
Holder's inequality with l/p+ 1/q = 1 to (67) (see, e.g., [24], page 191, for 
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an extension of the classical result to p < 0, (7 G (0, 1)). This leads to 



(69) 






dW'"^ 



dR 



iv) 



,il/(l-X)) Io"l(Vt,'^t,Yt)dt 



J'r: 



1/p 



But in view of (63) and our choice of p we see that 



[dR'l 



.{yii~^))£"yivt,i^t,Yt)dt 



Tr, 



£ 



pX 
1-A 



{u*{rit,Yt)-ut)dWi 



2,») 



Since the ltd exponential of a local martingale is always a supermartingale, 
it follows that the expectation in (69) is less than 1. Raised to the power of 
1/p <0, this estimate is reversed, and we obtain 



(70) y(r7,i/,yo,r„) >^p.[e('?/(i-^))(^W^"+^(^»)-^(^-))]'/'', 



Rn 



n£N. 



In our next step, we shall extend the measures Rn\j^T-„ , n S N, to a probability 
measure R^ on the cr-field Tt whose restrictions to Jv„ are equal to Rn\j^^^ 
for all n £ N. To this end, note that the sequence r^ increases to T and that 
the family {Rn\j^^„)nGN is consistent in the sense that R^^^{A) = Rn{A) for 



all A G Tr„ since 



dii/, 



dQc 



dill 



Tr.. 



(71) 



dRl 
■ 8 



dRY 



Tr. 



dRi 



r\.v 



dRl' 



Tr. 



dQo 



Tr. 



1-A 



{\Q{Yu) + r^]}Yu + r?^! + ^y{Yu)Pi) dWl 



+ / ^i'Yu^<'^^y[Yu)p2dWt 

'0 



n G N, is a discrete-time Qo-martingale. Thus the existence of a unique 
extension RP to o"(|J^gpj J>„) =Tt follows from [32], Theorem V.4.2. More 
directly, (71) suggests that we should define the probability measure R'^ 
on (0, J"t) by 



di?^ 



(72) 



dQo 



E 



Tt 



1 
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1-A 



(A0(y„) + r^l'Y^ + 7?f + ^y{J^)p{) dWl 



+ / ^i'Y^^^i' + ^y{Y^)p2dWt 

Jo J T 
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Since the functions 0, (p grow, at most, linearly, it follows similarly to page 6 
that W is well defined, that is, Eq^ldEP / dQQ\jr^] = 1. In particular, the 
corresponding Ito exponential is a Qo-niartingale up to time T, and in view 
of (71) this yields BP\t^^ = -Rn|j-^„ for all n G N. We thus see that esti- 
mate (70) is equivalent to 

V{ri,u,yQ,Tn) > ^^Je('?/(^-^))(^(^)^"+^(^°)-^(^-"))]^/'^ for any n G N. 

Now we are ready to replace the stopping times r„ by the deterministic 
time T by passing to the limit nfoo. Indeed, as shown in Lemma 4.1, the 
left-hand side increases to V{ri,i',yQ,T) as nfoo (cf. Lemma 4.1). Applying 
Fatou's lemma and then Jensen's inequality to the rightmost expectation, 
we now obtain the lower bound 

> ^{l/il~X])[A{X)T+ip[yo]+Ef^^ hviYr]]) 

for any finite horizon T and for all controls rj &C, v ^ M. Taking the scaling 
7iln(-)^^'^ on both sides and passing to the limit Tfoo, this yields 



lim-ln inf infy(r?,z.,yo,T)i-M >A(A)+ lim-infii;^J-^(yT)]. 



(73) V^m--miE^,[-^{YT)]=Q. 



Thus the constant A(A) provides a lower bound if 

1 

Indeed, Assumption 4.1(a) ensures that 99 grows at most quadratically, that 
is, there exists some constant Ki > with |y'(y)| < A'i(l + y^). Therefore, 
we have the bounds 



(74) -KAI + sup E^, [Y4] < inf E^, [-^{Yt)] < ATi 1 + sup ^^„ [Y^' 

Recall now from (68) that Y evolves under K^, rj £C, according to the SDE 

dYt = Ki7]t,Yt)dt + piYt)dWt\ 

Due to Assumption 4.1(b) there exist constants 02,0^ > such that the 
drift function k satisfies yK{rj,y) < —6*22/^ -|- C3 for all 7/ G F. Therefore, 
Lemma A. 2 ensures that 

sup sup Es^ \Yj'] < 2/0 + const. < 00. 

T>0»)6C 



But in view of (74) this implies (73), and hence 

lim — In ( inf inf ' 

rfoo T \u<^M riGC 



(75) lim ;^lnf inf mfV{i],u,yo,T)^~^) > A(A). 
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(2) In the second part we identify controls r]* &C and z^* G 7W such that 

(76) A(A)=limihi(y(7?*,i/*,yo,T)i-"). 

Tfoo I 

Together with (75) this imphes (56). Indeed, by compactness of T and con- 
tinuity of the functions I, h and u*[-,y) with respect to r/, there exists 

(77) rf{y) Gargmin{(l- X)l{7],u*{y,7]),y) + ipy{y)h{r],u*{y,r]),y)}. 

rjer 

By a measurable selection argument ry*(-) can be chosen as a measurable 
function. Set i'*{y) := u* {rj* {y) , y) [cf. (45)], and let rj* , u* be the feedback 
controls defined by rH := rfiYt)-, i^t '■— ^*0^t)-, t > 0. In that case, we have 
r]* €C, and one easily proves that the process i'* belongs to the class M. 
In order to verify (76), we now proceed as in part (1). As in (60) we obtain 



y(r/*,i.*,yo,T)=ii;^,.,.*[e/o"K'y?,<,>'0 



dt] 



The measure R^ ''^ is defined on {Q,J^t) in terms of the density £^ ''^ . 
Since i^*{ri, •) grows at most linearly, this change of measure can be justified 
in analogy to page 6. By Girsanov's theorem, the dynamics of Y under R^ ''^ 
follow the SDE 

(78) dYt = h{r,l ,u:,Yt)dt + p dwf ^'^ , 

where the drift function h is given by (35), and where {W"^ '^ )t<T is a two- 
dimensional Wiener process under R'^ ''^ (cf. page 19). Using the specific 
controls rj* , v* , the auxiliary function 7 in (62) satisfies 7(7/^ ,i^(*,yi) = 0, and 
we also obtain equality in (64). Along the lines of part (1) this implies 



y(7?*,i/*,yo,r) 



^{l/il~X)){A{X)T+^{yo)-v{YT))g f f ^M^p^^V'^ 



in analogy to (66). Once more the Ito exponential is interpreted as the 
density of a new probability measure R^ on (0, Ft) ■ Since the drift function 
h{r]* {■) , v* {■) , •) of y under R^ ''^ only depends on the control rj* and satisfies 
the linear growth condition \h{r]* (y) , v* (y) , y)\ < K2{l + \y\),we may proceed 
in analogy to page 6 to justify this change of measure. Then we get 

(79) l^(r7*,i/*,yo,T) = e(i/(i-^))(^W'^+^(^«)i?^,,[e-(i/(i-^))^(^^)]. 

Moreover, by Girsanov's theorem, the dynamics of Y with respect to i?'' 
are given by 

(80) dYt = K{r]lYt)dt + pdWf, 
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where (W^ )t<T is a two-dimensional Wiener process, and where the drift 
function k satisfies Assumption 4.1(b). In analogy to part (1), we now take 
the scaling ^^ ln(-)^~ on both sides of (79) and then pass to the limit T f oo. 
For this purpose, note that 



sup E^^, [Yrp] < oo and that 



T>0 



supE'p^* [exp(A;|yj'|)] < oo for any k G '. 
T>0 



due to Assumption 4.1(b) and Lemma A. 2 applied to the SDE (80). If ipy is 
bounded and consequently |v?(y)| < -^"3(1 + |y|), then this implies the uniform 
upper bound 



supii^ 
T>o 



R^* 



exp 



1 



1-A 



^(Yt) 



< supE 

T>0 



Rv* 



exp 



1 



1-A 



K3{1 + \Yt\) 



< 00. 



This uniform boundedness among all T clearly also holds, if (p is bounded 
below. In particular, the identity (79) translates into 



lim — ln(y(r?* 



,yo,T)'' 



:A(A). 



Thus we have shown (76). This ends the proof of (56). 

(3) In our last step we return to the initial problem of robust utility 
maximization. The finite horizon duality relation (26) holds for any (regular) 
convex class of measures, and in particular for the one-point set {Q^ }. In 
analogy to (29) it thus follows that the maximal value for expected power 
utility in the specific model Q^ satisfies the duality formula 

1-A 



U 



^^^' ^ A^ 



ml V{if,v,yQ,T) 

ueM 



Using this representation and the duality relation (29) for the whole set Q, 
we obtain (59) immediately from (56) and (58). D 

Theorem 4.1 shows that the solution {A{X),(p) to the EBE (54) specified 
in Assumption 4.1 describes the exponential growth of the maximal robust 
power utility Ut{xo) as Tfoo. We have also seen that the maximal utility 
in the specific model Q^ grows at the same rate as Ut{xq). In the next step 
we shall use these facts in order to identify an optimal long-term investment 
strategy vr* € A. For this purpose, we introduce the additional regularity. 

Assumption 4.2. Let (A(A),(^) be the solution to the EBE (54) intro- 
duced in Assumption 4.1, and let if denote the corresponding minimizing 
function. Then the function k defined by 



(81) 



k(?7,2/) ■=g{y) + 



A 



1-A 



pi(0(y) + r?"'*(y)y + r?2V(y)) 
1 



1-A 



2 , 2 
P1 + P2 



Vy{y) 



satisfies yK(?/, y) < —C^y"^ + C5 for all r/ E F with constants C4, C5 > 0. 
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Theorem 4.2. Under the regularity Assumptions 4-1 <ind 4. 2 we have: 

(i) The value A(A) given by the solution to the EBE (54) can be identi- 
fied as the optimal exponential growth rate 

A(A) = snpmhnmi Eq,[{X^)^] 

for robust expected power utility. In particular, (59) implies 

A(A) = lim -\nUT{xo) = lim -InC/^' (xq), 

Ttoo 1 T^oo 1 

where Q^ £ Q is defined in terms of the control r]* in (57). 

(ii) In the specific model Q^ , the maximal growth rate of power utility 

KQ,*{X):=snpmhnEQA{X^Tf] 
^ TveATtooT ^ 

coincides with A(A). 

(iii) Let n^ = Tr*{Yt), t>0, be the trading strategy defined in terms of the 
function (53). Then vr* belongs to class A, and it satisfies the optimality 
condition 

(82) A( A) = lim ^ In inf Env [(Xf )^] = lim ^ In E^,,* [(Xf )^1 . 

In other words, the strategy vr* and the measure Q^ € Q form a saddle point 
for the robust optimization problem (19). 

Proof. (1) Theorem 4.1 shows that the maximal power utility Ulf (xq) 
in the specific model Q^ grows exponentially with rate A(A), that is, 

A(A) = lim i \Tvuf (xo) = hm i In sup Eq,, [(X?)^]. 

Ttoo I Ttoo 1 ^g_4y ^ 

Since A C At, this implies 
A(A) > supm^lnEQ,,[{X^)^] > suph^ ^Inmf EQ4iX^)^] = A{X). 

neA^tooT ^ ^g^TtooT Q"GQ 

In order to verify that this chain of inequalities is indeed a series of equalities, 
it suffices to show that vr* belongs to A, and that 

(83) A(A) < hm iln inf ii;Q.[(Xf )^]. 

Ttoo -f CeS 

This yields the converse inequality A(A) < A(A), and hence the identity 
A(A) = A(A) = Aq^*(A). In particular, the strategy n* satisfies (82). 

Let us first show that vr* is admissible in the sense of Definition 2.1. 
For this purpose, note that the adapted process ttj = 7r*(Yi), t > 0, admits 



26 T. KNISPEL 

continuous paths and that the unique strong solution to (16) takes the form 

(84) Xf = xoe-^'''"'''^^"'''+-^()^''(^")+''''-[^(^")+'''"^"+''''']"(^/2)'''(''")''^") > 
for any t > 0. Thus the processes defined by the number of shares, 

et'°= * go and er' = ^r^, i>o, 

are continuous and adapted to the Brownian filtration, hence predictable. 
Moreover, the integrals in (15) are well defined for ^* = (^*''^,'^*'^). In other 
words, IT* associated with ^* is an admissible long-term investment process. 
To verify (83), we derive suitable lower bounds for infQv^Q Eqv[{X^* )^] 
for any finite horizon T and then pass to the limit. We first argue for a fixed 
control r] ^ C and the corresponding model Q^ E Q. Representation (84) 
yields the decomposition 



(85) EQ4{X}r] = x^EQ. 



T 



where we use, as in (47), the function I. In order to eliminate the Ito expo- 
nential, we introduce a new probability measure Q^ on {Q,J^t) with density 



(86) ^ 



dQ"-' 



:=£( [ XottI dWlA =£( [ XaTT* (Yt) dW^A 



This requires us to verify Eqv [dQ^ /dQ^lj^r^] = 1. Indeed, the factor process Y 
evolves under Q^ according to the SDE (14a), and the drift function satisfies 

\giy) + iP,V^-y + V^')\''<Ki{l + y^), 

due to Assumption 2.1 and compactness of T C M^. Thus, by Lemma A.l, 
there exists some constant K2 > such that supo<t<7- Eqv [exp(i^2^t^)] < co- 
Since |'/r*(y)| < K3{1 + \y\), this implies supj<y £^Q»j[exp((5(A(T7r*(Y'i))^] < 00 
as soon as 5 > is chosen sufficiently small. Therefore, [29], Example 3 of 
Section 6.2, guarantees that (86) defines a probability measure on {Q,Tt)- 
In particular, equation (85) becomes equivalent to 

(87) EQ,[{Xf)^] = 4i?Q,[ei'o^''(<'''"^')'^*]. 

By Girsanov's theorem, the factor process Y follows under Q'' the SDE 

(88) dYt = h{7rlr]t,Yt)dt + pdWl t<T, Yo = yo. 

Here (W^)t<T is a two-dimensional Q*?- Wiener process and the drift func- 
tion h is defined by (50). Note that the right-hand side of (87) can be viewed 
as a cost functional of an "exponential of integral criterion" with dynam- 
ics 
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In terms of the functions / and h the EBE (54) for the pair {A(X),ip) can 
be rewritten as 

(89) A(A) = -\\pf[ipyy + ifl] + M{T{7r*,rj, •) + ipyh{Tr*,r], ■)}. 

For clarity of exposition the precise arguments are postponed to part (2) of 
this proof. We now proceed in analogy to the proof of Theorem 4.1. Note 
that the roles played by /, /i are taken over hy I, h. 

Applying Ito's formula to c^ G C^(M) and to the dynamics (88) we obtain 

^{YT) = ^{yo)+l ^y{Yt)h{^l,'nt,Yt) + \\\p\Wyy{Yt)dt+ f ipy{Yt)pdWl 
Jo ^ Jo 

The alternative version (89) of our EBE thus yields the inequality 

v{YT)>v{yo) + j AiX)-Ti7r;,rjt,Yt)dt + ln£(j^y{Yt)pdWA . 

Rearranging the terms and taking the exponential on both sides, (87) allows 
us to deduce that 

Eq, [{Xf )^] = x^%, [^I,fTi^t,VuYt)dt^ 






-^^^-)£[jjy{Y,)pdW'>^ 



Applying once more a Girsanov transformation to eliminate the Ito expo- 
nential, we obtain 

(90) EQniiX^'f] > x^e^W^+'^(j'»)ii;Qje"'^(^^)], 

where the expectation is taken with respect to the probability measure Q^ 
on {Q,,Tt) defined by 



dQi 



dQ 



■.= £(1 ^y{Yt)pdW2 



In particular, (90) means that 

(91) hm iln inf i5;Q4(Xf )^] > A(A) + lim ^In inf i^^Je'^^^-)]. 

Since |/i(7r*(2/),ry,y)p < K/^{\ + y^), this second change of measure can be 
justified again by Lemma A.l combined with [29], Example 3 of Section 6.2. 
By Girsanov's theorem, the dynamics of Y under the new probability mea- 
sure Q^ is given by 

dYt = (h{7Tlrjt,Yt) + \\p\Wy{Yt)) dt + pdWj^, t < T, 
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where W^ is a two-dimensional Q''- Wiener process. Moreover, inserting the 
definition (53) of iT*{y), a straightforward computation yields the identity 

H-n-*{y),r],y) + \\pfipy{y)=K{ri,y). 

Here the function k introduced in Assumption 4.2 satisfies the inequality 
yK,{r], y) < —C^y'^ + C5 for all 77 G T with appropriate constants C4, C5 > 0. 
Thus, by Lemma A. 2, the quadratic moments Eq^[Y^] are bounded above 
uniformly with respect to all processes rj £C and T > 0, that is, 

supsupSgjy^]<i^5(i + yo)- 

T>0 r/6C ^ 

Note now that \f{y)\ < Kq{1 + y^) for some constant Kq > 0, since the first 
derivative ipy grows at most linearly [cf. Assumption 4.1(a)]. Using Jensen's 
inequality, we obtain the lower bound 

l^Q^nJ^^Q.I^^^^''"^] > i^f%[-V'(^T)] >-i^6(l + supEQjy^2]^ 

>-Ke{l + K5{l + yi)) 

for any finite horizon T. Thus the last term in (91) nonnegative, and so the 
desired estimate (83) follows from (91). 

(2) It remains to verify that the solution {A{X),ip) to our EBE (54) also 
satisfies (89) and vice versa. In other words, the EBE (89) is an alternative 
version of the original equation (54). For this purpose, we use the minimizing 
functions 77* and ly* defined in Theorem 4.1 and write rj* , v* and tt* instead 
of rf{y), v*{y) and 7r*(y) to simplify the notation. Then an easy but tedious 
computation yields the identity 

Thus the pair (A(A), 99) also solves the EBE (89) if and only if for all r/ G F 

(92) 0<V,r/,y) + (/Pj,(2/)/i(7r*,77,y)-[r(7r*,r/*,y) + ^,y(2/)/i(7r*,77*,y)]. 
Inserting formula (53) for vr*, this inequality takes the explicit form 

< ^ W - v'^'ly + iv'' - ri^'n] [0{y) + v'''*y + ^'''1 

(93) + 3^Pi9^,(y)[(r?i^ - v''ny + {rf' " ^'''*)] 
+ P2¥^,(y)[(r?2i-r?2i.*)y + (r722_^22,*)] 

for all ry G F. To derive (93), we fix 77 G F and define the convex combination 
"Ha '■= V* + '^{v ~ ''?*)) ct G (0, 1). Then T]a belongs to F, due to convexity 
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of this set. Moreover, using the minimizers Vj* ,u* and the specific choice 
K{y) '■= '^*iVa,y) = -rji^y -ni^ - P2{y)v'yiy), we easily derive the inequahty 

< (1 - x)i{?]a,Kiy)^y) + fy{y)Hria,K{y),y) 
-[{i-X)i{v*,i^*,y) + MyMv*,'^*,y)] 

= a[terms in (93)] + ^-^a^[(r/" - v^^'*)y + {rf^ - rf^^*)f . 
2 1 — A 

Dividing finally by a and letting afterwards a tend to zero yields the desired 

estimate (93) and equivalently (92). Thus we have shown that the solution 

(A(A),c^) to the EBE (54) also satisfies (89). This completes the proof. D 

Remark 4.2. The duality approach used above requires two verification 
theorems. The first one characterizes the growth rate of Ut{xo) in terms of 
the EBE (54), and the second one identifies an optimal long-term investment 
strategy and the associated optimal growth rate A(A). In this remark, we 
discuss heuristically a more direct approach to (19) via stochastic differential 
game techniques (see, e.g., [12] for an introduction). To this end, note that 
(if Xf > for ah t) 

where I is defined in (47), the measure R^'"^ is introduced in (48), and the 
dynamics of Y under R^^'^ is specified in (49). This suggests that 

UT{xo) = x^v-{y,T):=x^ sup inf ii;«...[e/o^^(-"''*'^')'^*], Yo = y, 

where f" can be seen as the upper value function of a stochastic differ- 
ential game with maximizing "player" vr and minimizing "player" rj. The 
function u" should be determined by the HJB-Isaacs equation 

1 

-|„.„ _,^^^ , _„„ , 

Using the heuristic transform lnf"(y,T) ~ lnC/T(xo) ~ A(A)T -|- ip{y), this 
translates into the following EBE of Isaacs type: 

^(^) = i;\\pf['Pyy + 'pI] + sup inf {7(7r, r?, •) + (Pyh{7r, r/, •)}• 

If this equation has a solution (A(A),c/5), then it is easy to show that sup 
and inf can be interchanged and that the saddle point is attained by vr*(y) 
in (53) and r]*{y) defined in (57); that is, the EBE of Isaacs type is ac- 
tually a version of (54). We conjecture that the alternative approach via 
differential games is also feasible. However, the detailed derivation would 
be a lenghty and technical exercise that is beyond the scope of the present 
paper. 



vt = nWpfv^y + sup inf {/(vr, r?, >" + /^(vr, r?, •)<}, i;"(., 0) ^ 1. 
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5. Existence of a solution to the ergodic Bellman equation. Our results 
rely on the existence of a specific solution (A(A),(/7) G IR+ x C"(M) to the 
EBE (54). More generally, an EBE is given by 

(94) K = Dip{x) + H{x,Vip) + q{x), x(^W^, 

where q maps from M to M, D is a second order differential operator, and 
where i7 is a real-valued nonlinear function of the gradient^Vy?, called the 
Hamiltonian. A solution to (94) is a pair (A, (/?) of a constant A and a function 
if : W^ — )• M. Such equations have been analyzed by various authors (see, 
e.g., [8, 25, 30] for a discussion related to risk-sensitive control problems, 
or [1, 2]). Unfortunately their existence results do not, in general, apply to 
our EBE (54). The main difficulty relies on three facts: we consider a model 
with nonlinear coefficients r, g and m appearing in the functions / and /i; 
the cost function / may grow quadratically in y; (54) exhibits a nonlinearity 
with respect to the first derivative ipy. If the discussion is limited to linear 
coefficients, then a quadratic ansatz may yield an explicit solution to (54) 
(see, e.g., [9, 33], and also Section 6.2 for a case study). 

Let us now turn to the existence problem for nonlinear coefficients. The 
EBE (54) can be rewritten in the condensed form 

~ 1 1 

(95) A(A) = -\\pfipyy{y) + ^{pfyiy)? + inf {n(7?,y) + (py{y)m{r],y)}, 



where we use the notation p:= y j^xPi + pi' 

n{r], y) := i^Y^^^^^^ + ''"^ + ''^^^^ + ^'^^^^' 
m{ri,y) := g{y) + ——T-pi{XO{y) + r]^^y + rj^^) + p2{'n^'^y + f]"^^). 

The following existence result is deduced from Fleming and McEneaney [8]. 
Their construction of a solution involves a parameterized family of finite time 
horizon stochastic differential games (see, e.g., Fleming and Souganidis [12]). 
The associated value function is characterized in terms o£a parabolic PDE, 
called Isaacs' equation, and the existence of a solution (A(A),(/9) follows by 
taking appropriate limits of the Isaacs' PDE when both "time" tends to 
infinity and the underlying parameter converges to zero. 

Lemma 5.1. In addition to Assumption 2.1 let us assume that 9 is 
hounded, that T C {(0,0)} x M? and that 

(96) ^K>{):gy{y) + -^piey{y)<-K for all y gR. 

Then there exist a pair A(A) G ]R_|_, ip G C^(M) that solves the EBE (54)- 
Moreover, we have \ipy\ < max^gr ||%('?5 Olloo/-?^, and so this solution also 
satisfies the regularity Assumptions 4-1 and 4 ■2- 
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Proof. Our assumptions ensure boundedness of n > 0, r]y and niy on 
r X M. Moreover, the mean value theorem combined with (96) gives 

(x — y){m{r], x) — m{r], y)) < —K\x — y\ for all x, y G R, ry G F. 

The functions n, m thus satisfy condition (7.2) in Fleming and McEneaney [8], 
and applying [8], Theorem 7.1, for 7 := (\/2yo)~^ and e := H/op/p^ the desired 
existence result follows. D 

6. Explicit results. 

6.1. BlackScholes model with uncertain drift. For constant coefficients 
r{y) = r and m{y) = m, the reference model Qq in Section 2 becomes the 
Black-Scholes model with price dynamics 

dS^ = Sfr dt, dSJ = Sl {mdt + a dW} ) . 

In particular, the market price of risk function 6{y) = ^^^^^— ^ is constant. Tak- 
ing the specific set F = {(0, 0)} x [a, 6] x {0}, a < < 6, each measure Q^ G Q 
corresponds to a drift perturbation of the following type: 

dSl = Sl{[m + cjr?P] dt + adwl'''). 

In this example the factor process Y plays no role. In particular, the maximal 
expected utility for a finite horizon does not depend on the initial state of the 
factor process. Hence the function (p appearing in the heuristic separation of 
time and space variables (43) is constant, and its derivatives (fy, ipyy vanish. 
The EBE (54) thus reduces to 

^ ^ -- ,21\2 , ,.2i , \„1 _ 1 ^ ;„c(fo , „2U2n 



The number A(A) can be expressed in terms of the element ry^^'* G [a, b] 
which minimizes the absolute value l^ + ry^^l among all r/^^ G [a,b]. Defining 
the constant controls r]^ := (0,0,77^^'*,0) and u^ := 0, t > 0, the verification 
theorems can be transferred to our present example in a simplified form 
which does not not require any additional conditions as in Assumptions 4.1 
and 4.2. As a result we get the following description of the aymptotics of 
robust expected power utility: 

• The maximal robust utility Ut{xq) grows exponentially with rate 

• A(A) =sup^g_4limTtoo7'lninfQr,gQ£;Q„[(XJ)^] = A(A). 

• The optimal long-term strategy takes the form 

i — A (T 
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• The asymptotic worst-case model Q"^ is given by the constant control 
rjf = (0,0,7y^^'*,0), and it does not depend on the parameter A. 

Remark 6.1. Using methods from robust statistics, Schied [37] shows 
that the measure Q^ is actually least favorable in the following sense: for any 
finite maturity, the robust utility maximization problem (17) is equivalent 
to the classical problem for Q^ , regardless of the choice of the underlying 
utility function u. 

6.2. Geometric Ornstein-Uhlenbeck model with uncertain mean reversion. 
As our second case study, we consider the case where the economic factor Y 
is of OU type, and where there interest rate r is constant. In our reference 
model Qq, the factor Y is assumed to be a classical OU process with constant 
rate of mean reversion ??o > and volatility o" > 0, that is, 

(97) dYt = -voYt dt + a dW} , Y^ = yo. 

We assume that Sj := exp(yt + at), a G M, describes the price process of the 
risky asset. By Ito's formula, the dynamics of S^ is governed by the SDE 

dSJ = S^adt + dYt + l d{Y)t) = S^{{-rjoYt + \a^ + a) dt + adWl). 

Hence this example corresponds to the general model of Section 2 for the 
choice g{y) = —7]oy, Pi = o", P2 = 0, m{y) = —rjoy + ^o"^ + a, and for the 
affine market price of risk function 

0iy) = - { -my + -o-^ + a - 

a \ 2 

Let us suppose that the investor is uncertain about the "true" future rate 
of mean reversion: instead of a constant rate we admit any rate process that 
is progressively measurable and that takes its values in some interval [a, b] , 
0<a<r/o<6<oo. This uncertainty about the true rate of mean reversion 
can be embedded into our general model by choosing the set 

rin — b rjn — al 

,- X {(0,0,0)}. 

a <^ J 

Indeed, let Q'^ G Q denote the probabilistic model generated by a F-valued, 
progressively measurable process rj = (??i)t>o; cf. (12). In view of (14a), the 
factor process Y then evolves under Q^ according to 

dYt = -(??o - (Tvl^)Yt dt + adWl'\ 

and the resulting mean reversion process (r^o — (^Vt^)t>o takes values in [a,b]. 
To prepare the analysis of the asymptotic robust utility maximization 
problem (19), we first solve its nonrobust version 

(98) maximize lim —InEQ^^KX^)''^] among all vr G ^ 
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for the specific model Qq. This problem has been studied, amongst others, 
by Fleming and Sheu [9] and Pham [33]. By the following proposition we 
recover their results as a special case of our general robust duality approach. 
To indicate the nonrobust case, we denote the optimal growth rate for (98) 
by Aqo(A). Note that Q = {Qo} if we take the one-point set F = {(0,0,0,0)}. 
Thus our general EBE (54) takes the simplified form 



Aqo(A) = V 



1 



Vra(y) + YZTx'^y^y'' 



+ Xr 



(99) 



1 A 



21-A 



- 7702/ + (1/2)^2 + a-r 



a 



+ ^yiy) 



1 



-voy + 



A 



1 



-a + a — r 



1 - A ' " 1 - A V 2 
where the infimum among all i/ G R is attained for i'*{y) = 0. 

Proposition 6.1. The EBE (99) has the solution 



(100a) AQ„(A) = ^(l-^/r^A)% + A('r + ^Qa2 + 



a — r 



(100b) ^{y) = \{l- Vr^A)^2/2 - A Q^2 + a - r ) y, 

which satisfies our regularity Assumptions 4-1 O'^d 4. 2. Thus it holds that 

Aq„(A) = hm iln[/^«(xo) = Aq,(A) = sup WR hn Eq,[{X^)\ 

Moreover, an optimal feedback strategy vr^ = TT*{Yt), t>0, for our investment 
problem (98) is given by the affine function 



(101) 



vr*(y) 



1 



% 



Vn^CT^ 



y + 



1 /I 



a^ 



-a + a — r 



Proof. Following [9] and [33] we are looking for a quadratic solution 
ip{y) = \-Ay'^ + By. Inserting the derivatives in (99) and comparing the coef- 
ficients of the terms in y"^, in y, and the constants yields that the EBE (99) 
holds for every triple (A, i?, Aqq(A)) satisfying the system of equations 

0=-a2yl2_^gyl + _^2^ 

= a'^AB + \i-a'^ + a-r\A- Bi]o ^(-a^ + a-r\r]o, 
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A«.(A) = l.^(^ + ^B^)+^(i,^ + „-.)B + V 



1 A ({l/2)a'^ + a-r^'^ 



21-A V a 



The quadratic equation for A has the solutions A± = (1 it vT^-^)-^- We 
choose A = A-, and we shah explain in Remark 6.2 why the other solution 
is irrelevant. A straightforward calculation gives B = — 1(2^'^ + a — r) and 

finally the expressions for AQg(A) and ip in (100). The parabola (p is bounded 
below, ify grows linearly and the functions k, k defined in Assumption 4.1(b) 
and 4.2 satisfy the regularity condition 

yK{0, y) = 2/k(0, y) = — -j==r]oy'^ . 

Applying Theorems 4.1 and 4.2 completes the proof. D 



Remark 6.2. Using the other root Aj^ yields ip{y) = ^A^y"^ + By and 

Aqo (A) = ^(1 + VT^^)vo + ^ r + ^ (l^^ + a-r] J. 

In particular, this example illustrates that the solution to an EBE is not 
necessarily unique. On the other hand, the "ergodicity" Assumption 4.1(b) 
selects the good candidate. Indeed, the proof of Theorem 4.1 requires that 
limj^l-oo y^rvI^t] ~ 0' where Y follows the SDE (68). Given the geometric 
OU model and the solutions ip{y) = 2^±y^ + By this SDE takes the form 

dYt = ±-j^=Ytdt + adWl'\ Yo = yo. 

The factor process Y is an "explosive" Gaussian process for the root A^ 
in the sense that limr-i-oo j^Ej^^[Y^] = 00. Thus the arguments used in the 
proof of Theorem 4.1 fail and so the solution associated with A^ is irrelevant. 
Conversely, taking A^, Theorem A. 2 applies to the ergodic process Y. 

As a complement to Proposition 6.1 we look at the maximal robust util- 
ity Urf°{xQ) attainable at time T and the asymptotics of the optimal invest- 
ment strategy vr*' as T"[oo. The following proposition extends Proposi- 
tions 5.6 and 5.7 in Follmer and Schachermayer [16] by including an interest 
rate r > and the additional drift component a for the price process S^. 

Proposition 6.2. For any initial condition Iq = yoi the maximal robust 
expected utility U^'^{xo) takes the form 

(102) U^%xo) = ix^[(A^)-i/2e^^(^«)+(^/(i-^))'^^+(^T)-^c^(j/o)]i-\ 
A 
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where we use the notation 

4 := 1 - 1(1 - (1 - A)-i/2)(l ± exp(-27?o(l - Xy'^'T)), 

BT{y) ■= -^[(1 - A)-V2 - (1 - X)-']y^ + ^x^ (^-^ + «--)?/ 
)((1 - A)-^/^ - (1 - A)-i) + i,^ Qa^ + a - r) 



??ol 



Cr(y) := ^((1 - A)-i/2 - (1 - A)-i) exp(-2%(l - Xr'/'T)y' 
1 ^ ^i^2^a_^^exp(-r/o(l-A)-V2;^)y 



a^ X-iy2 

,2 /I \2 



+ i^ (T^ (^' + « - r) (1 - exp(-2,o(l - A)-/^^). 

The optimal proportion vr^' is an affine function of the current state Yt of 
the factor process given by vr^' = a[T — t]Yt + b[T — t], where 

a[T-t] := -5(1 - A)-V2^+_^(A-_J-i, 



(j2 

b[T-t]:=i.(la^ + a-r 



l + (^-_J-l^e-.o(l-A)-V2(T-t)' 
1 — A 



Proof. Detailed computations can be found in [26], Chapter 4. D 
Since Aj, and Cxiyo) converge to a finite limit as Tfoo, we thus obtain 

lim iln[/««(xo) = (1 - A) Mm lfsT(2/o) + T^rT) =Aq,{X), 
in accordance with Proposition 6.1. Moreover, we have 

lim a\T — t] = , and Um b\T — t] = —^i -a"^ + a — r | , 

due to \miT'[ooArp = 2(1 + (1 — A)^^/^). Thus the asymptotic form of the 
optimal strategy vr*' as Tf 00 is given by 

*,T_ 1 „ T^ 1 A 2 



and so it coincides with the optimal long-term strategy vr* in (101). On the 
other hand, Fleming and Sheu [9] observed that limj"|-oo vr^ ' does not provide 
an optimal long-term strategy for power utility with parameter A < —3. 



36 



T. KNISPEL 



Let us now analyze the robust case. Since Aq(,(A) is increasing in rjQ, it is 
natural to expect that the asymptotic worst-case measure Q^ corresponds 
to the probabilistic model, under which Y has the minimal rate of mean 
reversion a. The following proposition confirms this conjecture. 

Proposition 6.3. For the geometric OU model with uncertain rate of 
mean reversion, the optimal growth rate of robust power utility is given by 

A^X) = ^il -VT^X)a + x(r + ^(^a^ + a-r^ ") > 0, 

and the maximal robust utility Ut{xq) grows exponentially at this rate. The 
asymptotic worst-case model Q^ is determined by i]^ = C""" , 0,0,0), and 
the optimal long term strategy vr* = TT*{Yt) is specified by the affine function 

*/ N la 1/1 

TT (y) = — 7^=^^y + ^ 



VT^Xa^ 



a^ 



-a + a ■ 



Proof. Replacing i]q in (100) by the minimal mean reversion a provides 
A(A) = 4(1 - Vr^A)a + A ( r + ^At ( 4f^^ + a 



-(1-Vr^)a + A r + ^ 



>0, 



1 



ifiy) = -{1 - Vi^xy 



A /I 



0"^ 



O"^ 



-a + a — r ]y 



as a candidate for the solution to the EBE (54), and it is easy to ver- 
ify that {A{X),ip) is indeed a solution. The corresponding minimizers are 
iy*{y) = 0, r]*{y) = (2^,0,0,0) G F. It remains to verify that (A(A),(/?) sat- 
isfies our Assumptions 4.1 and 4.2: since if £ C^(M) is a parabola, it is 
bounded below and its first derivative (py grows linearly. Moreover, the aux- 
iliary functions k, k appearing in our Assumptions 4.1 and 4.2 satisfy for all 



and 



yi^iv^y) 



yi^iviv) 



l-A 



(% 



ov'') 



1 



-{7]Q - a) + ar] 



11 



1 



y'< 



1 



^rr^ 



y'< 



1 



ay 



v^r^A 



ay 



due to r/^^ < '^" and rj^^'* = '^" " . We thus derive Proposition 6.3 as a spe- 
cial case of Theorems 4.1 and 4.2. D 



7. Application to a robust outperformance criterion. Utility maximiza- 
tion is conceptually related to specific numerical representations of the in- 
vestor's preferences. The application requires us to know the utility func- 
tion u which is by nature subjective. For institutional managers utility max- 
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imization thus creates severe difficulties. On the one hand, the preferences 
of their customers and the corresponding numerical representations are not 
really known exactly. On the other hand, the individual preferences of the 
managers and of the various customers with shares in the same investment 
fund will typically be different. This suggests that we should look for an 
"intersubjective" criterion for optimal portfolio management which is ac- 
ceptable for a large variety of investors. Such an alternative consists of eval- 
uating the performance of the portfolio relative to a given benchmark such 
as a stock index. The investor aims at outperforming the benchmark with 
maximal probability. If the benchmark is a contingent claim H at a terminal 
time T, then the outperformance problem reduces to maximizing the prob- 
ability Q[X^ ^ H] of a successful hedge. This criterion, known as quantile 
hedging, has been developed as a substitute for investors who are not willing 
or not able to raise the initial costs required by a perfect hedging or super- 
hedging strategy of H (see, e.g., Follmer and Leukert [15] and the references 
therein). 

Pham [33] proposed an asymptotic benchmark criterion for optimal long- 
term investment. Here the investor has in mind a level of return c and aims 
at maximizing the probability that the portfolio's growth rate 

Lt '■= j;lnXJ 

[or more generally j: ln[X^/ It) for an index process /] exceeds this thresh- 
old. For finite T this corresponds to quantile hedging for H = exp(cT). 
But what happens in the long run? If the growth rates LJ converge Q- 
a.s. as T t oo and satisfy under Q a large deviations principle with rate 
function I'^, then Q[L'^ > c] ~ exp(— I'^(c)T) as Tf oo; that is, the proba- 
bility that Lj, departs from its limiting value decays to zero exponentially 
fast. Thus the long term view amounts to minimizing the rates I^{c), or 
equivalently to 

(104) maximizing lim —lnQ[L^ > c] among all vr. 

An asymptotic benchmark criterion of this form may be of particular inter- 
est for institutional managers with long-term horizon, such as mutual fund 
managers. Note, however, that this ansatz does not take into account the 
size of the shortfall if it does occur. From a mathematical point of view, 
it leads to a large deviations control problem. On the other hand, stan- 
dard results from the large deviations theory (such as the Gartner-Ellis 
theorem; see, e.g., [6], Theorem 2.3.6) suggest that the rate function I'^ is 
a Fenchel-Legendre transform of the logarithmic moment generating func- 
tion 

AQ(A,7r) ■.= m^lnEQ[eM^TL-T)] = m^lnEQ[{X^n 

Tfoo 1 rfoo 1 
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In this spirit, Pham developed a duality approach to (104). His Theorem 3.1, 
relying on large deviations arguments, but not on the specific structure of 
the underlying market model, states that 

(105) supII^-lnQ[LJ>c] = - sup {Ac-Aq(A)}, 

TT ^too T A6{0,A') 

where Aq(A) := sup^ AQ(A,7r) is the optimal growth rate of expected power 
utility with respect to Q. Applications of Pham's theorem to specific market 
models can be found in [20, 22, 33, 34, 40]. 

However, the benchmark criterion (104) does not account for model am- 
biguity. To overcome this limitation, it is natural to study its robust version, 

(106) maximize lim —In inf Q\U^ > cl among all vr. 

The solution is derived in [26], Chapter 6, for the robust stochastic fac- 
tor model of Section 2, and it is closely related to the asymptotics of ro- 
bust utility maximization. Under suitable regularity assumptions [e.g., A 6 
C"'^((0, 1))] and lim;!^|;!^/ A'(A) = oo for some A' < 1 we obtain the duality for- 
mula 

(107) supI5I;^ln inf Q''[L?;>c] = - sup {Ac-A(A)}. 

TTG^noo T QveQ Ae{0,A') 

This can be seen as a robust extension of (105), but here the duality formula 
involves the optimal growth rates A(A), A € (0,1), of robust power utility. 
Moreover, the sequence of investment processes tt'^'", n S N, defined by 

^c,n_Ut{X[c+l/n]), forc>A'(0), 

""* "\7r*(A[A'(0) + l/n]), forc<A'(0), 

in terms of the optimal long term strategies vr*(A) for robust power utility, 
and in terms of parameters A[c] € argmax;^g(o,A'){'^c — A(A)} is nearly op- 
timal for (106). The proof is beyond the scope of this paper and therefore 
omitted. 

Example 7.1. For the geometric OU model with uncertain mean rever- 
sion (see Section 6.2) Proposition 6.3 shows that: 

• A(A) = i(l - Vl-A)a + A7 with 7 := r + ^{^a'^ + a- rf, 

• < (A) = -^^^Yt + ^(icT^ + a - r), t > 0. 

We thus obtain from (107) the optimal rate of exponential decay 

(a/4-c + 7)^ a 



sup lim — In inf Q\Ur > c] 



for - + 7, 

c — 7 4 

0, tor c < -- + 7. 

4 



vr.' : 
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Since A[c] = 1 — (jr^z))'^, the nearly optimal strategies are given by 

Remark 7.1. Another natural problem is to minimize the robust large 
deviations probability of downside risk 

(108) lim-lnsupQ[LJ<c]. 

TtoO T Q(ZQ 

Here the investor is interested in minimizing, in the long run, the worst-case 
probability that his portfolio underperforms a savings account with interest 
rate c. In the nonrobust case, this large deviation criterion has been pro- 
posed by Pham [33], but a rigorous solution was given first by Hata, Nagai 
and Sheu [21] for the special case of a linear Gaussian factor model. The 
solution can be derived by a duality approach which, in contrast to (105) 
and (107), involves the optimal growth rates A(A) of power utility with nega- 
tive parameter A (cf. Remark 2.1). For a detailed discussion of problem (108) 
see [26]. 

APPENDIX 

Let us finally summarize some technicalities. 

Lemma A.l. Let W be a two-dimensional Brownian motion on the 
stochastic base {Q,Q,G,Q), and let r] be a G -progressively measurable pro- 
cess taking its values in a compact subset T cM"'. Moreover, let {Yt)t<T be 
a continuous process that is a strong solution of the SDE 

(109) dYt = h{r]t,Yt)dt + adWu Yo = yo, ||a|| > 0, 
where the drift function /i : F x M — > R satisfies for all rj ^T, y G M 

h {r],y) < K (1 + y ) for some constant K. 
Then there exists 6 = 5{T) > such that supf^j- EQ[exjp{6Y^^)] < oo. 

Proof. The local martingale Bt := ||(T||~^(TWi, tG [0,T], satisfies {B)t=t. 
Thus, B is a one-dimensional Brownian motion, due to Levy's characteriza- 
tion. In particular, the SDE (109) can be rewritten as 

(110) dYt = h{r,t,Yt)dt + \\a\\dBt. 

The proof now follows in two steps: first we argue for a constant function 
h{y) = h. In that case, the solution to (110) is given by the Gaussian OU 
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process It = e^^{yo + /q e^'^'^llo"!! dBg), t G [0,T], and the claim follows easily. 
In a second step, we extend this result to the general case by a comparison 
argument. The details are given in [29], Theorem 4.7, restricted to the special 
case h{T],y) = h{y). D 

Lemma A. 2. Let {Q,Q,G,Q) be a reference probability system support- 
ing a two-dimensional Brownian motion W = {W^,W'^), and let rj be a G- 
progressively measurable process with values in a compact subset F C M . 
Furthermore, we suppose that Y is a strong solution to the SDE (109), 
where h is real-valued function such that 

3K,M>0,yr]eT: yh{r], y) < -Ky'^ + M, 

and where the volatility vector satisfies \\cr\\ > 0. Then it holds that: 

(i) There exist constants C, Cn > 0, n G N, such that 

snpEQ[Yt^^] < y2" + C„ and supEQ[\Yt\] < C{1 + \yo\). 
t>o t>o 

(ii) For all fc G M, sup^^Q EQ[exp{k\Yt\)] < oo. 

In particular, these bounds are uniform among the class of all progressively 
measurable T-valued processes rj. 

Proof. The proof is rather standard in ergodic control theory and ap- 
pears in single components under slight different assumptions in various 
papers (see, e.g., [8] or [21]). For a unifying version see [26], Lemma A. 2. D 
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